Turn taking and multimodal information in two-people dialog

This research focuses on the relationship between turntaking and intensity of motions (head, hand and upper body motions). We examine five spontaneous dialogues conducted in Japanese, which were collected using video and audio recording equipment, and optical motion sensing device. We show first that the motions appear more in speech duration than in pause. Next, we present some data showing that motions of chest and hand are more relevant to turn hold, and that motions of head do not have a signal function for differentiating the turn hold form the turn change.